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ABSTRACT 

The General Accounting Office (GAO) undertook this 
review to test the effectiveness of the Upward Bound program, which 
is administered by the Department of Health, Education, and Welfare's 
(HEW) Office of Education (OE) . This program was designed to provide 
low income students who are potentially successful but inadequately 
trained, with skills and motivation necessary to succeed in education 
beyond high school. The program is supposed to correct these 
students' faulty academic preparation by providing remedial 
instruction, altered curriculums, tutoring, cultural exposure, and 
encouragement. From 1965 through fiscal year 1973, about 206 million 
dollars was obligated for grants to and contracts with institutions 
of higher education and other qualifying public and private 
organizations for planning, developing, or carrying out this program. 
GAO reviewed 15 projects in Arizona, California, Florida, Georgia, 
Massachusetts, Nevada, New Hamprhire, Bhode Island, and Vermont that 
had obligated 12.1 million dollars through June 30, 1972. Although 
Upward Bound might be motivating students to enroll in college, OE 
does not know how effective the program has been in achieving its 
goals of equipping students with the academic skills and motivation 
necessary for success in college. Available data indicates that the 
program apparently has not achieved this goal. In terms of college 
retention and graduation. Upward Bound has been substantially less 
effective than indicated by earlier research studies and OE's annual 
evaluation report to the Congress. (Author/JM) 
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To the Speaker o£ the House o£ Representatives 
and the President of the Senate 

This is our report on problems o£ the Upward Bound 
program in preparing disadvantaged students for a post- 
secondary education. This program is authorized by title 
IV of the Higher Education Act of 1965, as amended (20 
U,S,C. 1068), and is administered by the Office of Educa- 
tion, Department of Health, Education, and Welfare. 

We made our review pursuant to the Budget and Account- 
ing Act, 1921 (31 [J-S.C. 53), and the Accounting and Audit- 
ing Act of 1950 (31 U.S.C. 67). 

We are sending copies of this report to the Director, 
Office of Management and Budget, and to the Secretary of 
Health, Education, and Welfare. 




Comp trol ler General 
of the United States 
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COMPTROLLER GENERAL'S 
REPORT TO THE CONGRESS 



DIGEST 



WHY THE REVIEW WAS MADE 

GAO undertook this review to test 
the effectiveness of the Upward 
Bound program, which is administered 
by the Department of Health, Educa- 
tion, and Welfare's (HEW's) Office 
of Education (OE). This program was 
designed to provide low income stu- 
dents, who are potentially success- 
ful but inadequately trained, with 
skills and motivation necessary to 
succeed in education beyond high 
school . 

The program is supposed to correct 
these students* faulty academic 
preparation by providing remedial 
instruction, altered curriculums, 
tutoring, cultural exposure, and 
encouragement. 

From 1965 through fiscal year 1973, 
about $206 million was obligated for 
grants to and contracts with insti- 
tutions of higher education and 
other qualifying public and private 
organizations for planning, develop- 
ing, or carrying out this program. 

GAO reviewed 15 projects in Arizona, 
California, Florida, Georgia^ Mas- 
sachusetts, Nevada, New Hampshire, 
Rhode Island, and Vermont that had 
obligated $12.1 million through 
June 30, 1973. 



PROBLEMS OF THE UPWARD BOUND PROGRAM 
IN PREPARING DISADVANTAGED STUDENTS 
FOR A POSTSECONDARY EDUCATION 
Office of Education 
Department of Health, Education, and 

Wei fare 
B-164031(l) 



FINDINGS AND CONCLUSIONS 

Although Upward Bound might be 
motivating students to enroll in 
college, OE does not know how effec- 
tive the program has been in achiev- 
ing its goal of equipping students 
with the academic skills and motiva- 
tion necessary for success in 
college. Available data indicates 
that the program apparently has not 
achieved this goal . 

In terms of college retention and 
graduation. Upward Bound has been 
substantially less effective than 
indicated by earlier research 
studies and OE's annual evaluation 
report to the Congress. (See p. 10.) 

in addition, OE's reported college 
enrollment and retention rates were 
overstated by 10 percent and 30 per- 
cent, respectively. (See pp. 14 
and 15.) 

Developing specific measurable 
objectives 

Contrary to HEW guidelines, OE did 
not develop .specific, measurable 
objectives for improving academic 
skills and increasing motivation. 
Also, objectives stated in project 
applications were generally ^ague 
and were not expressed in measurable 
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terms by type and degree of changes 
expected in student academic per- 
formance cind attitude toward school. 
(See p. 20.) 

Objectives should be stated in 
specific, measurable terms to pro- 
vide OE with standards for measur- 
ing program effectiveness and with 
means of identifying potential 
problems. 

Assessing educational needs 
and curin.culum design 

Project officials usually identified 
students' educational needs by re- 
viewing school records and talking 
with teachers and counselors; they 
did not document their findings or 
identify the variety, incidence, or 
severity of students' learning 
problems, (See p. 22.) 

Further, Upward Bouid curriculums 
were not designed to correct stu- 
dents' educational weaknesses most 
likely to adversely affect their 
success in college. 

Instead, students were assigned to 
certain classes regardless of 
wnether they had difficulty in 
mastering those class subjects. 
(See p, 23.) 

If the program is to be effective 
in equipping underachievers with 
skills and motivation to succeed 
in college, it would appear essen- 
tial that the project use formal 
achievement and diagnostic testing 
programs to assess each student's 

eeds before developing a curriculum 

ased on his needs. 

Management information system 

0E*5 management inforn.ation system 
did not: 



— Provide accurate and prompt data 
jn students' college enrollment, 
retention, and graduation. 

--Accumulate data to determine the 
program's effectiveness in equip- 
ping students with the skills and 
motivation needed to succeed in 
postsecondary education, (See 
pp. 10, 13, 16, and 25.) 

— Provide followup data on college 
enrollees to determine their 
academic performance, problems, 
and reasons for dropping out. 

This data would have helped to 
determine program effectiveness and 
to identify factors which adversely 
affect students' college performance 
that OE could have perhaps corrected 
by altering the program's strategy 
or by using resources of its other 
programs . (See p. 27. ) 

Monitoring the proc^ram 

OE's monitoring of Upward Bound was 
not geared to determining effective- 
ness of individual projects but con- 
sisted primarily of discussions with 
project officials; supporting files 
and records were usually not in- 
spected. (See p, 27,) 

Eligibility of students 

GAO's review of the records of over 
1 ,000 students showed that 22 per- 
cent were not underachievers and 
therefore may not have needed the 
program; also, 15 percent d:d not 
meet the family income criteria, 
(See p. 28.) 



RECOMmNDATIONS OR SUGGEb'TIONS 

GAG recommends that the Secretary 
of HEW require OE to: 
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-Establish clear, measurable 
objectives for the Upward Bound 
program and periodic milestones 
to iiieasure the program's effec- 
tiveness in accomplishing objec- 
tives as required by HEW's Opera- 
tional Planning System. (See 
p. 31.) 

-Require projects to (1) document 
comprehensive need assessments on 
all students, including motiva- 
tion levels, (2) design a curric- 
ulum to meet identified needs, and 
(3) periodically measure progress 
made in meeting these needs. 

-Improve the management informa- 
tion system so program managers 
are provided with the data needed 
to develop, plan, and evaluate the 
program* (See p. 31 . ) 

-Strengthen the monitoring program 
to insure that all projects oper- 
ate in accordance with national 
intent. (See p. 31 • ) 



— Require regional offices to insure 
that projects select students in 
accordance with guidelines and 
document the basis used. (See 
p. 32.) 

AGENCY ACTION AND UNRESOLVED ISSUE S 

HEW generally agreed with GAO recom- 
mendations requiring projects to per- 
form comprehensive needs assessment 
on all students and to periodically 
measure progress made in meeting 
these needs. HEW outlined actions 
to implement these recommendations. 
(Soe p. 32.) 

MATTERS FOR CONSIDERATION 
BY THE CONGRESS 

Congressional committees have ex- 
pressed interest in programs to 
assist disadvantaged students in 
obtaining a pos tsecondary education. 
This report should be useful to 
those comnittees having oversight 
responsibilities for this program. 
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CHAPTER 1 
INTRODUCTION 

Upward Bound is a precollege preparatory program 
designed to generate the academic skills and motivation 
needed for success in education beyond high school. The 
target group to be served are those low- income youths who 
have potential for success in a 2- or 4-year college but 
who, without the program, would not have considered college 
enrollment, nor would have been likely to have gained ad- 
mission to or successfully completed college because of in- 
adequate high school preparation and/or underachievement . 

Under authority of the Economic Opportunity Act of 

1964, as amended (42 U.S.C. 2809), the Office of Economic 
Opportunity (OEO) funded 17 Upward Bound projects as a pilot 
program in the summer of 1965. In June 1966 the Upward 
Bound program began nationwide; over 200 colleges, universi- 
ties, and residential secondary schools participated. On 
July 1, 1969, OEO's responsibility for Upward Bound was 
transferred to the Office of Education (OE) , Department of 
Health, Education, and Welfare (HEW), and is currently au- 
thorized under section 408 of the Higher Education Act of 

1965, as amended (20 U.S.C. 1068). 

ADMINISTRATION AND OPERATION OF THE PROGRAM 

OE headquarters is responsible for administering Upward 
Bound and for developing policies for program operation, 
funding, and evaluation. The headquarters was also respon- 
sible for administering individual projects until this func- 
tion was delegated to HEW's 10 regional offices on January 1, 
1972. 

The regional offices are responsible for reviewing and 
approving project proposals, providing technical assistance 
to institutions operating projects, and evaluating the 
effectiveness of individual projects. 

Accredited colleges, universities, and--in exceptional 
c:>ses--secondary schools submit project proposals outlining 
their plans to correct faulty academic preparation and the 
lack of motivation of Upward Bound students by remedial 
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instruction, altered curr iculums , tutoring, cultural 
exposure, and encouragement so that the students can 
succeed in higher education. 

Project proposals are evaluated, approved, and funded 
annually. The grant awards are supposed to be competitive; 
however, proposals from existing projects generally receive 
funding priority over proposals for hew projects. Grants 
may be discontinued if projects fail to follow program 
guidelines or to cooperate with other projects for dis- 
advantaged students in their geographic areas. 

Although the program is designed to help students who 
have completed the 10th and 11th grades, OE considers pro- 
posals to help students who have completed only the 8th and 
9th grades when dropout rates are severe. OE guidelines 
discourage recruiting of students who have graduated from 
high school because they would be enrolled in the program 
for only one summer which v.ould not allow adequate time for 
the project to provide the services and assistance needed to 
prepare them for postsecondary education. 

A typical Upward Bound project includes a summei: and 
an academic year component. The summer component is a 6- to 
8-week residential program on a college, university, or 
secondary school campus, where the students are provided 
academic and cultural enrichment classes, tutoring sessions, 
and academic and personal counseling. ^ 

The primary purpose of the academic year component is 
to maintain the gains made during the intensive summer 
session. During this period students live at home and 
attend their area high schools. Project personnel maintain 
contact with the participants through Saturday classes or 
tutorial/counseling sessions and periodic cultural enrich- 
^ ment activities. 

In addition to receiving educational services. Upward 
Bound participants receive a stipend of not more than $30 a 
month and certain health care services. 

Upward Bound project directors are responsible for 
planning, implementing, and operating their projects. They 
determine project content and appropriate costs. OE guide- 
lines require that project directors be on the faculty of 
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the institution where the project is being conducted. In 
addition, they are to have demonstrated sensitivity to the 
type of students participating in Upward Bound and, whenever 
possible, to have had experience in working with dis- 
advantaged students. OE further requires that project 
directors be employed full time during the summer and the 
academic year components for the entire grant period. 

A I^^b^t's teaching staff must include both college 
and seccf^^p-y school faculty. Teachers are to be selected 
on the basis of their experience with, and understanding of, 
the type of students in Upward Bound. 

FUNDING 



Federal funds totaling about $206.1 million were obli- 
gated for the program from its start in 1965 through 
June 30, 1973, as follows: 



Program 


Number o£ 


Annual 


Federal funds 


year 


projects 


enrol Iment 


obligated 


1965-66 


^25 


3,261 


$ 3,225,000 


1966-67 


218 


20 ,333 


25 ,000 ,000 


1967-68 


249 


23,507 


28,000,000 


1968-69 


285 


26,639 


30,000,000 


1969-70 


300 


25,743 


30,723,000 


1970-71 


292 


27,346 


29,600,000 


1971-72 


302 


26 ,426 


30,000,000 


1972-73 


316 


'^24 ,786 


°29,599,000 


Total 






$206,147,000 



Of the 17 projects funri-rd in the summer of 1965 , 8 were 

funded as separate projects during the following academic 
year. 

Estimates based on interim reports. 

Federal funds totaling about $12.1 million were obli- 
gated as of June 30, 1973, for the 15 projects we reviewed. 
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PROGRAM PARTICIPATION 



OE reported that, as of January 17, 1973, 90,805 
students had participated in the Upward Bound program and 
19,238, or about 21 percent, were still enrolled. The re- 
ported educational status of the remaining 71,567 former 
participants is shown below. 
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EDUCATIONAL STATUS 
OF PORKER UPWARD BOUND STUDENTS 
REPORTED BY OE AS OF JANUARY 1973 




OE records show thot 3,069 of these Upword Bound groduotes planned to enroll in other postsecondory progroms; 
however »0E does not follow up on ony postsecondory activities except college. 
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CHAPTER 2 



UPWARD BOUND PR0GRAJ4 RESULTS 

Although Upward Bound might be motivating students to 
enroll in college, OE does not know, nor is there sufficient 
data available in the Upward Bound management information 
system to determine how effective the program has been in 
achieving its stated goal of equipping students with the 
academic skills and motivation necessary for success in 
college. Limited available data indicates that the program 
apparently has not achieved this goal. 

In terms of college retention and graduation. Upward 
Bound has been substantially less effective than indicated 
by earlier research studies and OE's annual evaluation re- 
port to the Congress. 

GOALS ESTABLISHED 

The goal of Upward Bound, as set forth in the authoriz- 
ing legislation and the program manual, is to generate the 
academic skills and motivation necessary for success in 
education beyond high school for "academic risk" students 
from low- income backgrounds who have academic potential, OE 
guidelines state that the Upward Bound student is charac- 
terized as an "academic risk" for college education because 
his lack of educational preparation and/or underachievement 
in high school is such that he would not have considered 
enrollment, nor would he have been likely to have gained 
admission to, and successfully pursued, an academic career 
at a 2- or 4-year college without the benefits of the 
program. 

To measure the extent to which the program goal has 
been achieved, OE uses data in its management information 
system on the college enrollment, retention, and graduation 
of former Upward Bound students. The system, however, does 
not contain any data on the academic skills and motivation 
levels of students when they enter and leave the program. 

OE noted in its fiscal year 1973 budget justification 
to the Congress that about 40 percent of the high school 
graduates from low- income families enroll in college on 
their own initiative , compared with about 60 percent for all 
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high school graduates. OE concluded that Upward Bound must 
concentrate on enrolling the additional 20 percent from low- 
income families. OE did not indicate, however, what per- 
centage of Upward Bound college enrollees were expected to 
graduate . 

PREVIOUS EVALUATIONS OF THE EXTENT 
TO WHICH GOALS HAVE BEEN ACHIEVED 

In its fiscal year 1971 Annual Evaluation Report on 
Education Programs, dated January 1972, OE reported to the 
Congress that 66.8 percent of the Upward Bound graduates 
from 1966 through 1970 had enrolled in college compared with 
national averages of 60 percent of all high school graduates 
and 40 percent for all low- income high school graduates. OE 
also reported that a February 1970 evaluation report by 
Greenleigh Associates, Inc., a private consulting firm, 
showed that : 

--Upward Bound students generally represented the 
academically underachieving and economically dis- 
advantaged youth in America. 

--The Upward Bound program was an effective drop out 
prevention program as well as a channel to college. 

--College retention rates of Upward Bound graduates 
were equal to or greater than the national average. 

OE told us that, although there had been a number of 
studies of Upward Bound, the Greenleigh study was the only 
comprehensive evaluation of the program's effectiveness. 
This study was made under contract with OEO at a cost of 
about $128,000, and covered the program from its start 
until its transfer to OE. 

OEO stated that the evaluation was designed to assess 
how successful Upward Bound has been in achieving its major 
goal. The study was based on a synthesis of previous 
studies on selected aspects of Upward Bound; an analysis of 
data in the management information system on present and 
past enrollees; and interviews with project directors, 
teachers, tutors, and students at 22 regionally dispersed 
Upward Bound projects. 
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Greenleigh did not evaluate the extent to which Upward 
Bound equixjped eligible students with the academic skills 
and motivation needed for college success. Greenleigh 
stated that earlier research studies indicated that Up^vard 
Bound did a good job in increasing students • motivation for 
college but had little or no impact on their academic skills. 

Greenleigh concluded in its report, however, that the 
'^results of slightly more than 4 years of Upward Bound are 
an incredible success story." According to the report, the 
College enrollment rate for Upward Bound graduates was about 
70 percent for 1967-69, which was consistently higher than 
the national average for all high school graduates. The re- 
port also stated that, on the basis of available data for 
1966-69, Upv/arJ Bound students enrolling in college had re- 
tention rates equal to or bel:ter than those of the national 
norm and projected that their graduation rates would also 
equal or better the national graduation rate of 50 percent. 
Greenleigh stated that the reasons for the high ret^'ntion 
rates could only be conjectured because the Upward Bound 
management information system had insufficient data. 

Although nor specifically mentioned as a factor con- 
tributing to the high retention rates, Greenleigh reported 
that many of the Upward Bound particij^/^" ts were outside the 
target group and did not need the pr<>v, ram to succeed in 
college. For example, the report pointed cut that: 

--Many of the participants, particularly in the early 
years of the program^ ma/ have been academically able 
youngsters who did not need the program rather than 
underachieve rs who would not have gone on to college 
without Upward Bo^md. 

--Many of the students were already enrolled in a 
college preparation curriculum when they entered 
Upward BoU'»d, from 1966 to 1969 only 10.2 percent of 
the parti .^ipants changed from another curriculum type 
to a college prepatory one while enrolled in the 
program. 

-*^"gh schools often recruited their best students for 
Upward Bound because they believed a poor showing 
v;ould reflect on the school. 
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OE told us that it tentatively plans to have a 
contractor make a comprehensiv^e evaluation of the Upward 
Bound program in fiscal year 1974 under the direct super- 
vision of its Office of Planning, Budgeting, and Evaluation 
which is responsible for evaluating all OE programs. 

OUR EVALUATION OF THE EXTENT TO 
WHICH GOALS HAVE BEEN ACHIEVED 

Our evaluation of the program's effectiveness, as 
measured by the college enrollment and retention and gradua- 
tion rates included (1) an analysis of data showing student 
progress over a period, which was available in the manage- 
ment information system, and (2) a determination of the 
accuracy of the reported educational status of former Upward 
Bound participants in the 15 projects. 

A number of factors outside the program, such as family 
or personal problems and availability of financial assist- 
ance, also determine whether an Upward Bound student will 
succeed or fail in college. For this reaspn, college en- 
rollment, retention and graduation statistics alone do not 
appear to be adequate criteria for measuring the effective- 
ness of Upward Bound in achieving its stated goal. We be- 
lieve that a better measure of effectiveness is the extent 
to which Upward Bound has increased the participants' skills 
and motivation. 

OE does not accumulate any baseline data on students' 
academic skills and motivation levels when they enter Upward 
Bound; nor does it know to what extent the program increased 
these factors, if at all. However, we were able to obtain a 
limited amount of academic test data at several projects and 
at some of the high schools Upward Bound students attended. 
We also obtained information on students' performances in 
college and conducted certain statistical tests of the 
relationship between students' time in the program and the 
extent to which they enrolled and succeeded in college as 
indicators of program effectiveness. 

College enrollment^ retention , 
and graduation data 

According to OE's February 1973 college retention 
report, 68 percent of all Upward Bound graduates and 
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73 percent o£ graduates from the 15 projects had enrolled 
in college. In verifying OE's data for the 15 projects with 
college registrars, however, we found that 10 percent of the 
students who reportedly had enrolled in college had not. 

The report also showed an average retention and gradua- 
tion rate of 62 percent for all Upward Bound graduates who 
enrolled in college from 1965 through 1972. Such an average 
may, however, be misleading as a measure of program effec- 
tiveness because it includes the higher college retention 
rates of the more recent Upward Bound high school graduates-- 
which range from 64 percent for the 1970 graduates up to 
99 percent for the 1972 graduates. For example, in Septem- 
ber 1970, an internal OE report showed that, of the more 
than 15,000 Upward Bound students who enrolled in college 
during 1966-69, 71 percent were still enrolled. Our analy- 
sis of OE retention data furnished to us in February 1973 
for the same groups of students shows that only 39 percent 
were still enrolled or had graduated. A comparison of OE^s 
reported retention rates for the same students at different 
times is shown below. 



Year students completed 

Upward Bound program 

1966 1967 1968 1969 Total 



Number of students 
enrolling in 

college 605 3,529 6,242 5,351 15,527 

Percent of students 
still enrolled-- 

Sept. 1970 53 51 67 91 71 

Percent of students 
still enrolled or 
graduated- - Feb . 

1973 39 26 38 46 39 



The differences in the retention rates are attributable 
to the fact that, in the earlier report, sufficient time had 
not elapsed to allow the retention rates to even out. Many 
of the students subsequently dropped out of college, causing 
the average retention /ate for the 4-year period to decline 
to 39 perccnt--ll percent less than the national graduation 
rate for all college enrollees. Because of problems in 
updating the data in its management information system 
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(see 18), OE counts many students as still enrolled even 
though they liave dropped out. OE'a February 1973 statistics 
showed that about 9 o£ every 10 students included in the 
39 percent retention rate for 1966-69 were reportedly still 
enrolled in college; therefore, it is reasonable to expect 
a further decline in the reported average retention rate as 
OE updates the data in its management information system. 

Although OE stated in its 'annual evaluation report to 
the Congress in March 1973 that the Greenleigh study showed 
college retention rates of Upward Bound graduates aS equal 
to or greater than the national average, this study covered 
the period before the program's transfer from OEO to OE. OE 
has not given the Congress more current year-by~year data 
which would have shown lower retention rates. 

The following table illustrates on a year-by-year basis, 
the number of high school students who entered Upward Bound, 
completed the program, enrolled in college, and were cur- 
rently enrolled in or graduated from college according to 
statistics furnished by OE in February 1973. 



Year entered Upward Bound program 





1965 


1966 


1967 


1968 


1969 


1970 


1971 


1972 


Hev Upward Bound entrants 


1,384 


14,394 


11,172 


13,169 


12,072 


13,757 


14,256 


10,584 


Currently enrolled in 

Upward Bound 
Upward Bound graduates 
Initially enrolled in college 
Currently in college 


1,374 
971 
118 


12,710 
8»988 
2,381 


7,967 
5,359 
2,191 


9,331 
6,747 
3»866 


8,027 
5,678 
4,381 


1»769 
7,5A0 
5,288 
4,937 


7,605 
3,152 
2,211 
2,179 


9,866 
265 
189 
188 


Graduated from 2- or 4-year 
college 


263 


671 


184 


67 


IS 


1 






Note: These statistics furnished by OE 


were the 


most current data 


available 


in the 


Upward Bound 



management information systero as of February 1973. The number of Upward Bound participants 
reported above as having graduated from 2- or 4'year colleges totals 1,2:04, whereas the coirect 
total should le 996 as shown on page 9. OE officials explained that students who earned 
degrees from both 2- and 4-year colleges were counted twice by the computer when summarizing 
data on program participants by the year they entered Upward Bound. 

In comparing our actual enrollment and retention data 
with the most recent data in OE ' s management information 
system for the 15 projects, we found that OE overstated by 
30 percent the number of students enrolled in college or 
graduated. 

Part of this difference is attributable to a timelag in 
updating the Upward Bound management information system. 
When we began our review in May 1972, the most current 
college regis trar- verified data in the system was as of 
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September 1970. OE's spring 1972 survey o£ college 
registrars, which verified student enrollment and retention 
as o£ September 1971 was not in the system until October 
1972. We verified with college registrars that many students 
had dropped out of college after September 1971 and that this 
data was not available to OE management. 

OE officials told us that some of the differences could 
also be attributed to errors in the raw data and programing 
and key punching errors made in transferring the information 
to the computer. In addition, we learned that OE does not 
always receive an annual report on retention from college 
registrars. Unless notified to the contrary by the regis- 
trar, OE presumes that the students are still enrolled even 
though some may have dropped out. 

OE's reported college enrollment and retention data is 
also misleading because some of the Upward Bound students at 
the projects we visited were outside the target group. We 
could not determine the extent of this problem at the 
15 projects because files generally did not have baseline 
data on the academic skills and motivation levels of the 
students when they entered the program. However, our review 
of six projects disclosed that 22 percent of the former stu- 
dents who enrolled in or graduated frona college may not have 
needed the program because, about the time they entered the 
program, they had B averages or better a'nd relatively high 
scores on- standardized academic achievement tests. 

Academic skills and motivation 

Because factors other than l^demic preparation and 
motivation can determine whether a student will succeed or 
fail in college, the extent to which Upward Bound increases 
the skills and motivation needed for success in education 
beyond high school is probably a better measure of program 
effectiveness than college admission, retention, and gradua- 
tion rates. However, data on skills and motivation is gen- 
erally not available in the management information system or 
at the project offices. 

Only 1 of the 15 projects had both pretest and posttest 
data on the academic achievement skills of all their stu- 
dents. This data showed that the students were approximately 
2 to 4 years below grade level when they entered the Upward 
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Bound program and were still about 2 to 4 years beloxi grade 
level when they graduated from the program. Limited data at 
another project disclosed similar results. Also, some stu- 
dents who scored at or above grade level on the pretest did 
not maintain month- £or-month growth in academic achievement 
equal to their progress in actual grade placement. 

Because of the limited information available on the 
extent to which Upward Bound increased academic skills, we 
obtained information on academic performance in college as 
a proxy measure of Upward Bound's effectiveness in this 
area. The information college registrars provided showed 
that a high percentage of dropouts had low grades and that 
some of those remaining in college appeared to be having 
academic problems . 

Information on the college performance of 792 former 
Upward Bound students at the 15 projects who dropped out of 
college showed that 508, or about 64 percent, had been on 
probation or had grade point averages below 2.0 (C averages). 
Of these, 168, or about 33 percent, had been academically 
suspended. Also, 378, or about 74 percent had left college 
with less than a 2.0 grade point average before completing 
1 year's credit. Available performance data on 561 or 623 
students still attending college at June 1972 showed that 
141, or about 25 percent, were on probation or had less than 
2.0 grade point averages. 

Our statistical tests of the relationship between the 
students' time in the program and the extent to which they 
enrolled and succeeded in college indicated that the program 
had increased the motivation of students to enroll but had 
not adequately prepared their academic skills to succeed in 
college. !Ve used college enrollment data as a proxy measure 
of motivation and college retention and graduation data as a 
proxy measure of academic preparedness. 

We hypothesized that students with more exposure to the 
program- - measured in months of participation- -would be more 
likely to enroll in and succeed in college. 

The results from our statistical tests indicate that 
the IS projects have succeeded significantly in wotivatlng 
participants to enroll in college. However, we found the 
association between exposure to the program and college 
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retention to be insignificant; those v;ith more exposure were 
not succeeding at significantly higher rates than those with 
less exposure. The tables below show in aggregate the data 
used in our statistical tests for July 1966 to June 1972. 



Association Between 
Program Exposure and College Enrollment 





Did 


student 


enro 11 


in college? 


Months in 








Yes as a 


program 


Yes 


No 


Total 


percent of total 


1 to 10 


198 


555 


753 


26.3 


11 to 20 


849 


713 


1 ,562 


54.4 


Over 20 


745 


419 


1,164 


64.0 


Total 


1 .792 


1.687 


3,479 


51.5 




Association 


Between 


Program Exposure 




and College 


Retention and 


Graduation 




Is student still enrolled or graduated? 


Months in 








Yes as a 


program 


Yes 


No 


Total 


percent of total 


1 to 10 


91 


95 


1&6 


48.9 


11 to 20 


414 


386 


800 


51.8 


Over 20 


366 


350 


716 


51.1 


Total 


871 


831 


^1 .702 


51.2 



The difference between this figure and the total number of 
students shown above as having enrolled in college is due 
to incomplete responses from college registrars. 

Viewing the 14^ projects separately, our analyses showed 
a positive and significant association between program ex- 
posure and college enrollment for 12 proiects--ll highly 
significant associations and 1 significant association. The 
relationship for the 13th and 14th projects was insignificant. 



^U*e did not separately analyze the 15th project because we 

considerod the number of participants insufficient for a 

ncjiningful test. 
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Our analyses showo.d a positive and highly significant 
association between program exposure and college retention 
for only one project. The relationship for 11^ projects was 
insignificant. (See app. I.) 



1 

We did not separately analyze 3 projects because we either 
considered the number of participants insufficient for a 
meaningful test or the distribution of amounts of time in 
the program did not allow a meaningful test. 
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CHAPTER 3 



FACTORS AFFECTING PROGRAM SUCCESS 

Some factors which have contributed to the limited 
effectiveness of Upward Bound are: 

--0E has not established clear, measurable objectives 
to be accomplished by Upward Boiond within a specific 
time, contrary to HEW^s requirements. 

--0E does not require projects to (1) identify students' 
educational needa and motivation levels, (2) base 
curriculums on those identified needs, or (3) measure 
the progress in overcoming students' weaknesses. 

--OE's management information system does not provide 
program officials with accurate and prompt data on 
program results. 

--0E does not have an effective monitoring system for 
determining the success of individual projects in 
accomplishing their goals. 

--0E has no assurance that the program is serving the 
intended target group. 

NEED TO DEVELOP SPECIFIC , 
MEASURABLE OBJECTIVES 

In 1969, KEIV established an Operational Planning System-^ 
to help management make internal decisions on resource al- 
locations on the basis of the end results expected from a 
given amount of resources. The system handbook requires 
HEW activities to develop clear, measurable objectives indi- 
cating what each program intends to accomplish in terms of 
output or impact, and to set milestones to measure effective- 
ness in achieving the objectives. The handbook states that 
objectives which indicate only the services to be provided or 
resources to be committed are unacceptable. 

The Upward Bound objectives established by OE and the 
three regional offices visited, however, did not include a 
statement of the expected end results. Instead, the 
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objectives were stated in terms o£ the resources to be 
committed; the number o£ projects to be funded; the total 
number o£ students to participate in the program; the number 
of Spanish surnamed and American Indian students to be 
served; and certain processes to be stressed in the curri- 
culum, such as drug education, reading skills, and career 
education. The only reference to the impact or end results 
of the program was the broad statement of "equalizing oppor- 
tunities for postsecondary education for lov;-income students." 



Also, the three regional offices did not require the 
projects to establish clear, measurable objectives. Objec- 
tives in the project applications were generally vague and 
were not expressed in measurable terms indicating the types 
and degree of changes expected in the academic skills and 
motivation of students. Although one project had developed 
these types of objectives and a plan to achieve them, it 
did not implement the plan. 



We discussed with OE officials the need to develop 
measurable objectives which clearly state the expected end 
results of the program in terms of student performance. 
These officials agreed that such objectives were needed and 
stated that OE was attempting to cor/iply with the Operational 
Planning System but had not set a target date for developing 
these objectives. 



NEED TO DIAGNOSE STUDENTS^ EDUCATIONAL 
NEEDS AND DESIGN APPROPRIATE CURRICULUMS 



OE has not required Upward Bound projects to make a 
comprehensive assessment of students* educational needs or 
to implement any type of formal academic achievement and 
diagnostic testing program. Such tests appear to be an 
essential part of the educational needs assessment and cur- 
riculum development processes if Upward Bound is to effec- 
tively equip underachievers with the skills and motivation 
they need to succeed in college. 



Educational needs not determined 



Current educational literature suggests that, to effec- 
tively correct underachievers* academic weaknesses, the 
nature and extent of their deficiencies must first be deter- 
mined through a process commonly referred to as educational 
needs assessment. Standardized academic achievement and 
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diagnostic pretests and posttests help to assess students' 
educational needs and to evaluate their progress. The tests 
help to minimize the likelihood of misplacing an individual 
or not giving him essential educational services by 

--identifying students likely to have trouble in school, 

--isolating specific academic deficiencies or other 
difficulties, such as perceptive and motor disabili- 
ties, language disabilities, and emotional problems, 

--assisting project officials in developing a prescrip- 
tive instructional program based on individual needs, 

--identifying students who should be referred for 
medical or psychiatric attention, and 

--evaluating progress and identifying future educational 
needs . 

Officials at the 15 projects stated that they usually 
determined whether students were underachievers by reviewing 
school records and talking to teachers and counselors. How- 
ever, they did not document their findings or conduct de- 
tailed educational needs assessments to determine the 
variety, incidence, or severity of students' learning 
problems . 

None of the projects visited had a formal academic 
achievement and/or diagnostic testing program to identify 
students' academic weaknesses and to measure their progress 
in overcoming weaknesses. Officials at five projects told 
us teachers tested students after they were assigned to a 
class to determine the level of instruction needed. Another 
project gave standardized academic achievement pretests and 
posttests but did not use the results for developing it's 
curriculum development or evaluating the project. At this 
project students were assigned to academic classes alphabeti- 
cally, even though more objective data on student needs was 
available . 

OE has proposed amendments to the Code of Federal 
Regulations which would require project officials to make 
and clearly document a diagnostic evaluation of a student's 
educational needs upon entering the program and a prognostic 
evaluation of achievement upon completing it. Upward Bound 
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officials were reluctant, however, to require the projects 
to implement any type of formal testing program using 
standardized academic achievement and diagnostic tests. 
They said such tests were biased and that project teachers 
vjevf^ capable of determining students' educational needs. 

Although we recognize that opinions differ on the 
value of standardized achievement tests as a measure of 
educational gain, these tests were predominantly used to 
evaluate the effectiveness of Federal- and State-sponsored 
experimental education programs. For example, standardized 
achievement tests are used to measure the academic gains 
made by disadvantaged children participating in OE-funded 
elementary and secondary education programs . 

We believe that, until more acceptable instruments are 
developed, these tests would be useful in assessing the needs 
and measuring the academic progress of Upward Bound students. 

Curriculums not designed to meet 
students' educational needs 

The Upward Bound curriculums at 14 of the 15 projects 
visited were not designed to overcome students' specific 
academic weaknesses which were likely to have an adverse 
effect on their success in college. Motivating the students 
toward college and personal success and developing their 
self-images seemed to be stressed more than correcting faulty 
academic preparation. As a result, many of the students en- 
rolled in college had severe academic problems. 

During the summer component, students generally took 
two to four required classes, such as English, mathematics, 
and reading, and were offered electives in such subjects as 
guitar and drum playing, modern dance, drama, motion picture 
production, and ceramics, which were offered mainly to 
motivate students. High school graduates were also provided 
regular college subjects or prerequisites for college courses, 
such as preparatory English. 

All 15 projects assigned students to certain classes 
regardless of whether they had difficulty in mastering 
those class subjects. In addition, 10 projects provided 
classes, which were also available at the local high school, 
to help students gain high school credit and/or to complete 
prerequisites for admission to college. Only 2 of the 15 
^rojects assigned students to classes because of documented 



weaknesses, and they had not done this on a continuing 
basis . 

The academic year component consisted mainly o£ bi- 
weekly or semimonthly counseling and tutoring as the stu- 
dents thought necessary. Some projects also had structured 
classes which were held weekly to monthly. 

Generally, attendance was a problem. Students attended 
the sessions only when they thought necessary and apparently 
their progress in school was not checked to determine the 
need for additional tutoring. Some tutors told us they 
functioned primarily as personal counselors. Tutoring and 
counseling sessions were rarely documented. 

Project officials at eight institutions said their 
curriculums were not remedial in nature; however, students 
were given individual attention and tutoring that was not 
available in most high schools. They commented that all 
students were assigned to the basic classes because under- 
achievers generally needed help in English, mathematics, and 
reading. Also, OE and project officials believed that moti- 
vating the students was as beneficial for college success 
as was remedying academic weaknesses. Although we do not 
discount the importance of motivation, we believe that poor 
academic performance of Upward Bound students in college, 
as discussed in chapter 2, demonstrates the need for more 
eraphasis oh improving academic skills. 

NEED TO IMPROVE THE 
MANAGEMENT INFORMATION SYSTEM 

OEO established the Upward Bound management information 
system before the program's transfer to OE. As part of the 
system a contractor gathers each project's data on current 
and former students. The contractor processes the data 
through HEW's computer and prepares reports for OE and 
project officials. The basic data available in the informa- 
tion system is described below. 

Current enrollees - -The project staff must report each 
new enrollee's date of birth, age, race, sex, family 
income, grade level, grade point average, and high 
school academic program. 
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Former enrollees — The project staffs must report, for 
each student who left the project, his reason for leav- 
ing., grade level, grade point average, current educa- 
tional status, postsecondary course of study, and em- 
ployment status . 

Retention survey --The contractor verifies, through an 
annual survey of college registrars, the cur"":^rt educa- 
tional status of all former students previo?{- vy reported 
by the project or having enrolled in col].rje. The con- 
tractor verifies this data. 

Project profile report --The contractv>v compiles infor- 
mation for all projects, includinc: p^/rtic ipants , current 
and former students , their report r.-:^ educat ional status , 
grade point average, sex, pover^: • income selection cri- 
teria, and reasons for leavip.f . The project profile 
report summarizes the above v .racteris tics on all 
students . 

According to the Upwanj Sound information i^ystem manual, 
the system is supposed to provide OE and its regional offices 
with data for decis ionm^^.^ t ng , program management, analysis 
and evaluation, and fur^dTf^g purposes. It is also supposed 
to provide project oti'cials with data for planning and 
evaluating their ira." ..dual programs. 

The system, however, is not designed to accuunulate 
baseline data cv; the academic skills and motivation levels 
of students "-'T Lheir progress in overcoming identified weak- 
nesses. ?';-:b information would seem essential for determin- 
ing the j» r f c;ctiveness of the program in achieving its objec- 
tives* Although the system includes provisions for gathering 
dat^ ov. students* grade point averages when they enter and 
leuw the program, grade point averages alone are not neces- 
?ur.iiy good indications of academic achievement levels because 
o^' the wide variances in academic standards among high schools. 

In addition, the projects do not accumulate grade point 
averages on a continuing basis. For example, the projects 
had no grade point averages at program entry for over 43,000, 
or about 48 percent, of over 90,000 students who had enrolled 
in Upward Bound as of January 1973. They also had no grade 
point averages at program exit for 37,000, or about 52 per- 
cent, of the 71,000 former students. 
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As discussed previously the management information 
system's only measures of program effectiveness are statis- 
tics on students' college enrollment and retention and gradu- 
ation, and much of this data is not accurate or prompt. 

The system does not provide for accunulating data on 
students' college performance, such as grade point averages, 
units attempted and completed, and reasons for dropping out. 
This information would be useful in determining the effective- 
ness of the program in accomplishing its objective and in 
identifying factors which adversely affected students' per- 
formance that 01: could perhaps correct by altering its pro- 
i:ram strategy or by using the resources of other OH programs. 

The Greenleigh rep rt on Upward Bound also noted a need 
to obtain college performance data, includinjg the reasons for 
dropping out. The report suggested that such data be ob- 
tained and analyzed at least twice yearly for all college en- 
rollees to aid in present and future program policy planning, 
research, and evaluation. 

OH officials agree that college performance data on 
students should be obtained, including units attempted and 
completed, as well as their college grade point averages. 
Further, an effective follot^up system to gather information 
on the reasons why students dropped out of college would be 
beneficial. However, they believe the additional cost would 
bo prohibitive. At least part of this inforiration could be 
obtained during the annual college retention survey at little 
or no additional cost to the Hovernment. Also, many social 
programs include provisions for obtaining? such information 
for use by management. 

01- contracted with a private consulting firm on June 30, 
19"2, to determine the type of information which should be 
collected in the future. OF: officials said that they had 
not been fully satisfied with the firm's work to date and 
that they were still considering the need for additional data. 

\'::r.n to improvi; momtorixg of thi: program 

In addition to using the data obtained from the manage- 
ment infor.^ation system to monitor and evaluate projects, OF: 
nakes 2- to 3-day site visits. 0!;*s regional staffs ;ire ro- 
njired to conduct site visits at least once a year for each 
•^reject. Consultants occasionally will make site visits 
O icn ;F. personnel cannot. 
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Available reports on the projects visited since the 
program began indiCn^ite that the visits were concerned pri- 
marily with progran processes and adherence to guidelines. 
The reports contained little information on the effective- 
ness of the results the projects achieved. Regional office 
and project officials said the visits consisted primarily of 
discussions with project staffs and that supporting files and 
records usually were not reviewed. We believe ]j^rriodic ex- 
aminations of project records would have alerted OH officials 
to many of the problems discussed in this report. 

An 01: regional official advised us that not all projects 
were vir>ited in fiscal year 1972 ap.d that some projects had 
not been visited since June 1971» primarily because of staff 
1 i mi tat ions . 

Oi: officials agree that they need a better monitoring 
system for determining the effectiveness of projects in ac- 
complishing well defined objectives; howjver, they said they 
have been handicapped by staff reductions since the program 
was transferred from OHO. According to these officials, OKO 
had administered the program primikvrily through a contractor 
with an average personnel strength of 50 employees and 
through 6 OI.O full-time professionals. As of June 1^ 1 973 , 
under a decentralized management system covering HHW*s 10 re- 
gional offices, 01: had a total of only 32 employees, includ- 
ing 21 professionals, who were responsible for administering 
not only the Upward Bound program but also the Talent Search 
and Special Services for Disadvantaged Students programs. 

N HLD TO LIMIT PARTICIPATION TO TAR G ET GROUP 

Properly determining students' eligibility to partici- 
pate in Upward Bound is important to insure that limited 
program funds are used to help only thof^e students that the 
Congress intei^ded. Many of the students selected may not 
have needed the program since their grade point avera/^es and 
standardized academic achievement test scores at program 
entry did not indicate they were underach;4?vers . Also, some 
of the participants did not meet the program's income 
criteria. 
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Students selected not academic risks 



Upward Bound guidelines state that students selected for 
the prog, an should be identified by the project staff as aca- 
demic risks, that is unde rach i e ve rs with potential. People 
who know the students, such as counselors and teachers, are 
to identify students' potential. However, 01: does not define 
what it means by an ujidcrachievcr in terns of educational de- 
ficiencies. Such 35 high school grades or scores on achieve- 
nent tests. 

Only \ of the 15 projects documented the factors it 
considered in identifying un de rachi eve rs . Project directors 
generally stated that they reviewed students' high school 
records but usually gave more weight to the subjective evalu- 
ations by project staff, counselors, and teachers. At three 
projects, officials told us they relied primarily on their 
evaluations of students* applications and high school coun- 
selors* recomnenda t ions and did not interview the students. 

Lducational consultants and specialists told us that 
students who scored at or above the 40th percentile on stand- 
ardized achievement tests probably could succeed in college 
without remedial help. Students who had both this percentile 
rating and above-average high school grades would be even 
less likely to need renedial help. 

^^*e obtained data on standardized achievement test scores 
and grade point averages for 1,045 students from project 
files and records of participating high schools. K'e found 
that 226 students, or 22 percent, had scored at or above the 
40th percentile on standardized achicvcrsent tests and had at 
least B averages at or near the tine they entered Upward 
Bound . 

Although these students probably benefited from Upward 
Boundy they may have required only counseling and motivation. 
They appeared to be more suitable candidates for Ot*s less 
expensive Talent Search program which is designed to encour- 
age low- income students with high potential and adequate per- 
formance to complete higli school and enroll in pos tseconda ry 
education. Talent Search costs about $24 a year for each 
student compared with about $1,140 for each Upward Bound 
student . 

O 
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Students^ family incomes exceed guidelines 



Upward Bound guidelines state that at least 80 percent 
of the students must meet the poverty income guidelines es- 
tablished by the Bureau of the Census and that up to 20 per- 
cent in slightly higher income brackets (criteria A and B) 
can be selected at the discretion of project directors. Stu- 
dents are considered to have met the income eligibility test 
if: 

--They live in federally supported low-income housing. 

--Their family receives state or federally funded wel- 
fare . 

--Their family income is seri usly mismanaged so that 
little, if any, is available for thr* students. Writ- 
ten testimony is required from a reliable third party 
to support this contention and show that it is a sig- 
nificant hardship on the student. 

Oi;*s national office has recognized that a relatively 
high percentage of students selected for the projects do not 
meet the family income criteria. It noted that 28 percent 
of the program participants during 1971 did Mt meet criter- 
ion A and 15 percent exceeded criterion B by over $500, Be- 
cause of apparent violations in all regions, OK sent a letter 
dated June ^a, i972, to all regional offices requesting that 
they insure that all projects in their regions correct the 
vio 1 at ion . 

Our review of income data on 1,180 students at 12 proj- 
ects showed that the reported family incomes for 178, or 
IS percent, of the students cixceeded both criteria A and B. 
Some of the reasons for noncoinfc Trance with the guidelines 
were the projects' acceptance, without verification, of in- 
come reported verbally by students; the use of net income 
instead of gross income; classification errors; and the 
rounding down of reported income by as much as $909. Some 
project directors did not enforce the incorae guidelines be- 
cause, in their opinion, the criteria were too low. 

Oil stated that violations of the income guidelines has 
a significant impact on program's assistance to the poor 

in view of the limited population served as compared with the 
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total nuTTiber of eligible students. OF estimates that 
3^0,000 lOK-incone students are eligible for Upward Bound, 
but the program currently is serving about 25,000, or only 
1 out of every 14 eligible students. Selecting students who 
do not njcet the incone guidelines reduces the target popula- 
tion's chances for receiving benefits. 
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CHAPTER 4 



CONXLUSIOSS AND REC0M?-tENDATIO NS 

Limited available data shows that, although Upward 
Bound apparently has motivated students to seek a college 
education, it does not appear to have been effective in 
achieving its goal of equipping students with the skills 
needed to succeed in college. Without the basic learning 
skills needed to cope with college, even the highly moti- 
valcu Ntiidenl will have a difficult and possibly insurmount- 
nble task. Thercfcre, we think it is essential that OE em- 
phasire the teaching of those sf^^cific academic skills in- 
dividual students need to succeed in college. Ke recormnend 
that the Secretary of HI K direct OE to: 

--Establish clear, measurable objectives for the upward 
Bound program and periodic milestones to measure the 
program's i^f f ect i veness in accomplishing the objec- 
tives as required by HHW's Operational Planning Sys- 
tem, or: should also require that the projects es- 
tablish similar objectives. 

--Require projects to (1) perform and document compre- 
hensive need assessments on all students, including 
their motivation levels, (2) design a curriculum to 
meet the identified needs, and (3) periodically mea- 
sure the progress made in meeting these needs. The 
guidelines should also include additional guidance to 
assist the project in accomplishing these three re- 
qu i remen t s . 

--Improve the management information system so program 
managers are provided with the data needed to develop, 
plan, and evaluate the program. The system should 
provide program managers the data needed to (1) assess 
students' specific educational needs, (2) identify 
their major problems, (3) devise specific strategy 
for overcoming these problems, (4) implement an educa- 
tion program responsive to students* needs, (5) mea- 
sure progress toward meeting goals, and (6) assess the 
effectiveness of the program and each project. 

--Strengthen the monitoring program to insure that all 
projects operate in accordance with program intent 
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and that the stated objectives of the projects are 
realistic and are beinR accomplished within the ex- 
pected tine. 

--Require regional offices to insure that projects 

select students in accordance with the guidelines and 
document the basis used. OE should provide projects 
with guidelines defining an academic risk student in 
terns of such achievement measures as standardized 
achievement tests and gra4e point averages. As an 
additional control, OE should include an editing 
process in its computer which would automatically 
identify students who do not meet the academic risk 
and income criteria. 

AGENCY COMMENTS 

In a letter dated November 28, 1973 (see app. II), HEW 
agreed with our recommendations, with certain qualifications, 
and outlined the actions initiated and to be taken to correct 
the matters discussed in this report. The qualifications 
pertained to our recommendation that OE require projects to 
perform and document comprehensive needs assessment on all 
students, including their motivation levels, and to period- 
ically measure the progress made in meeting these needs. 

HEK noted that there are many ways in which student 
motivation can be ascertained, including the development o^ 
psychological profiles on students; however it did not be- 
lieve developing such profiles was an activity in which it 
or the Upward Bound projects should be involved. 

We are not recommending that psychological profiles be 
used for measuring student motivation. As HEW has indicated, 
there are many ways in which this can be accomplished. The 
point is that the impact of Upward Bound on motivating stu- 
dents should be measured; how it is measured is not of pri- 
mary importance. 

HEW also stated that comprehensive assessment and mea- 
surement of students' needs can be performed with a variety 
of instruments and techniques, including standardized tests; 
however, it did not support the policy of basing assessment 
and measurement solely on standardized tests, nor did it be- 
lieve that every project should be required to use identical 
assessment and measurement techniques. 
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We are not recommending that HEW base the assessment 
and measurement of student needs solely on standardized 
tests > nor are we recommending that all projects be required 
to use identical assessment and measurement techniques. The 
instruments and techniques used to assess and measure a stu- 
dent's educational needs will depend, in part, on the nature 
and severity of his educational deficiencies. 

Standardized tests do become important, however, in 
measuring (1) the academic progress of irdividual students 
and (2) the effectiveness of each project and the program as 
a whole in equipping students with the skills they need to 
succeed in college. Although it is not essential that all 
projects be required to use identical tests, some degree of 
consistency and uniformity would be of value to OE management 
as one of the factors to be considered in evaluating program 
e f f ect iveness . 

HEW stated that in April 1973 a procedure had been im- 
plemented in the Upward Bound information system to identify 
individuals reported over the income guidelines. According 
to HEW, only 4 percent of current Upward Bound students 
presently exceed income eligibility criteria. We did not 
verify the accuracy of the 4 percent rate, but as we pointed 
out, many projects were not conforming to OE*s income guide- 
lines. We believe, therefore, that this area of program ad- 
ministration warrants OE*s continuous efforts to insure that 
only eligible students participate in the program. 
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CHAPTER S 



SCOPE OF REVIEW 

We evaluated the effectiveness of the Upward Bound pro- 
gram in assisting qualified low- income students to obtain 
the skills and motivation necessary to succeed in education 
beyond high school. We also determined the extent to which 
students entered and stayed in, college. ♦ 

At OE headquarters in Washington, D.C., and at HEW re- 
gional offices in Atlanta, Boston, and San Francisco we in- 
terviewed OE officials and reviewed policies, regulations, 
practices, and procedures for administering the Upward Bound 
program. We also examined several consultants' reports on 
the program. At project offices we examined project propos- 
als, records, and reports, and interviewed project officials, 
tutors, counselors, teachers, and administrators. The 15 
projects reviewed were located in Arizona, California, 
Florida, Georgia, Massachusetts, Nevada, New Hampshire, 
Rhode Island, and Vermont. 
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GAO ANALYSIS OF THE ASSOCIATION BETWEEN PROGRAM EXPOSURE 

AND COLLEGE ENROLLMENT AND COLLEGE RETENTION 

We used a statistical analysis technique to obtain data 
on the extent to which Upward Bound met its objectives. This 
analysis is intended to help support the conclusions reached 
rather than to serve as the basis for the conclusions. 

SCOPE OF ANALYSIS ' 

We analyzed the association between: * 

--Program exposure and the extent to which participants 
were motivated to enroll in college. 

--Program exposure and academic preparedness for college. 

We analyzed all 15 projects together^ 14^ of the 15 pro- 
jects individually for motivation and 12^ of the 15 projects 
individually for academic preparedness, 

MEASURES USED 

Because direct measures of the variables analyzed were 
lacking, we used the following proxy measures. 

--Program exposure- -number of months of participation. 
We selected the categories used in the analyses on the 
basis of length of participation frequency distribu- 
tions for the projects reviewed. 

--Motivation--extent to which participants enrolled in 
college. 

--Academic preparedness--extent to which participants 
remained in or graduated from college. 



^We did not analyze certain projects because we either con- 
sidered the number of participants insufficient for a mean 
ingful test or the distribution of amounts of time in the 
program did not allow a meaningful test. 
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BASIC ASSUMPTION 

The basic assumption for the analysis was that increased 
exposure to Upward Bound should increase the motivation and 
academic preparedness o£ participants. 

USE OF CHI -SQUARE TEST OF INDEPENDENCE 

The purposes of the chi-square tests o£ independence 
were to establish whether an association (dependency relation 
ship) existed between the variables we tested and to obtain 
an indication o£ the strength of identified associations. 

For example, in the table below we can see that those 
with longer time in the program did proportionately better 
in terms of college enrollment than those with less time in 
the program. 

Analysis of the Association Between 
Program Exposure and College Enrollment 



Did student enroll 
Months in in college? 



program 


Yes 


No 


Total 


1 to 10 


S 


42 


47 


11 to 20 


31 


59 


90 


Over 20 


103 


63 


166 


Total 


139 


164 


303 



But is the difference in proportions significant or is 
it merely the result of chance variations? How sure can we 
be that the difference is not a product of chance? We used 
the chi-square test of independence to answer these questions 

Using a chi-square statistic and a chi-square table, we 
determined the significance of the association between vari- 
ables tested and a confidence level which represents the 
probability that the association was not a product of chance. 

We interpreted the confidence levels obtained with the 
chi-square tests of independence using the following defini- 
tions. 
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Confidence that observed 
association is not a 
product of chanc e 

95 percent or greater 
90 to 94 percent 
80 to 89 percent 
Less than 80 percent 

The statistical details 



Definition of association 

Highly significant 
Significant 

Borderline significant 
Insignificant 

of our analyses follow. 



Analysis of the Association Between 
Program Exposure and College Enrollment 
All 15 projects 

Did student enroll 



Months in 




in college? 




program 


Yes 


No 


Total 


1 to 10 


198 


555 


753 


11 to 20 


849 


713 


1,562 


Over 2 0 


745 


419 


1,164 


Total 


1,792 


1.687 


3,479 



Significance of association: highly significant. 

Degrees of freedom: 2 
Chi-square value: 269.475 
Confidence level: 0.99+ 



Analysis of the Association Between 
Program Exposure and College Retention 
All 15 projects 
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Months in 


Is 


s tudent 
enrolled 
graduated 


still 
or 

9 


program 


Yes 


No 




Total 


1 to 10 


91 


95 




186 


11 to 20 


414 


386 




800 


Over 20 


366 


350 




716 


Total 


871 


831 




1,702 
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Significance of association: ins ignifi^ » 

Degrees of freedom: 2 
Chi-square value: 0.483761 
Confidence level: 0.20 to 0.3^C 

✓ 

Analysis of th e r,.\j r rc i at ion Be tween 
Program Expos ure Cf^ d College Enrollment 
v. :v: 1 1 tut ion A 



Did student enroll 
Month in college? 



program 


Yes 


No 


Total 


1 to 10 


72 


79 


151 


11 to 20 


94 


53 


147 


Over 2 0 


9 


6 


15 


Total 


175 


158 


313 



Significance of association: highly significant. 

Degree of freedom: 2 
Chi-square value: 8.09926 
Confidence level: 0.98 to 0.99 

Analysis of the Association Between 
Program Exposure and College Retention 
Institution A 



Is student still 
enrolled or 
Months in graduated? 



program 


Yes 


No 


Total 


1 to 10 


34 


38 


72 


11 to 20 


49 


40 


89 


Over 20 


_Z 


_6 


8 


Total 


85 


84 


^69 



Significance of association: insignificant. 

Degrees of freedom: 2 
Chi-square value: 3.12653 
O onfidence level: 0.70 to 0.80 
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Analysis of the Association Between 
Program Exposure and College Unrollment 
Institution B 



Months in 



Did student enroll 



program 


Yes 


No 


Total 


1 to 2 0 


29 


19 


48 


Over 2 0 


44 


11 


63 


Total 


73 


H 


111 



Significance of association: insignificant. 

Degrees of freedom: 1 
Chi-square value: 0.696948 
Confidence level: 0.50 to 0,70 

Analysis of the Association Between 
Program Exposure and College Retention 
Institution B 



Months in 



Is student still 
enrolled or 
graduated? 



program 


Yes 


No 


Total 


1 to 2 0 


17 


12 


29 


Over 2 0 


19 


24_ 


43 


Total 


36 


36 


72 



Significance of association; insignificant. 

Degrees of freedom: 1 
Chi-square value: 0.923817 
Confidence level: 0.50 to 0.70 
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Analysis of the Association Between 
Program Exposure and Col lecc Enro 1 Inent 
Institution C 



Months 



Pi J student enroll in college? 



in pro£ran 




Yes 


Ko 


Total 


1 to 20 
Over 20 




34 

23 


76 
25 


110 
46 


Total 




57 


£01 


158 


Significance of association: 


significant 




Degrees of 
Chi - square 
Conf i dence 


freedom : 
value : 
level : 


1 

3.48654 
0.90 to 0 


.95 




Analysis of 


the Association Between 




Program Exposure and College Retention 








Institution 


C 




Months 




Is student still 
enrolled or graduated? 


in program 




Yes 


No 


Total 


1 to 20 
Over 20 




21 

11 


11 
5 


32 
22 


Total 




38 


16 


S4 


Significance of association: 


insignificant. 




Degrees of 
Chi- square 
Confidence 


freedom ; 
value : 
level : 


1 

0.38163 
0.30 to 0 


. 50 





o 
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Analysis of t h e Association Between 
Program Exposure and College Enrollnsent 
Institution D 



Months 


Did 


in program 


Yes 


1 to 10 


3 


11 to 20 


21 


Over 20 


16 


Total 


40 



No 

12 
34 
20 

66 



Total 

15 
55 
36 

106 



Significance of association; 

2 



Degrees of freedom 
Chi- square value: 
Confidence level: 



insignificant. 



2,7024 

0.70 to 0.80 



4 Vj A «A ^ jr ^ mJ 



of the Association Between 



Program Exposure and College Retention 
Institution D 



Months 
in program 

1 to 20 
Over 20 



Is student still 
enrolled or graduated? 



Yes 

10 

9 



No 

14 

7 



T otal 

24 
16 



Total 



19 



21 



40 



Significance of association: insignificant 



Degrees of freedom; 
Chi-square value: 
Confidence level: 



1 

0.338346 
0.30 to 0.50 
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Analysis of the Association Betveen 
Progran ExpCt^surc a n d College Enrollnent 
Institution E 

Months Did student enroll in college? 



in progran Yes So Total 

1 to 10 6 55 61 

11 to 20 39 38 77 

Over 20 _86 _72 158 

Total 131 165 296 



Significance of association: highly significant. 

Degrees of freedom: 2 
Chi-square value: 37.1995 
Confidence level: 0,99^ 



Analysii^ of the Association Between 
Program Exposure and College Retention 
Institution E 

Is student still 
Months enrolled or graduated? 



in progran Yes No Total 

1 to 20 32 13 45 

Over 20 kl ^ 

Total 87 44 131 



Significance of association: insignificant. 

Degrees of freedom: 1 
Chi-square value: 0.395557 
Confidence level: 0.30 to 0.50 
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Analysis of t he Association Between 
Program Exposure and Colle£e Enrollnent 
Institution F 



Months 
in progran 

1 to 10 
Over 10 



Did student enroll in college? 
Yes No Total 



6 

138 



14 

33 



20 
171 



Total 



} 44 



47 



191 



Significance of association: highly significant. 

Degrees of freedon: 1 
Chi-square value: 22.1534 
Confidence level: 0.99* 



Analysis of the Association Between 
Trogram Exposure and College Retention 
Institution F 



Months 
in progran 

1 to 10 
11 to 20 
Over 2 0 



Is student still 
enrolled or graduated? 



Yes 



No 



Total 



Total 



Note: No analysis was performed because the dis- 
tribution of months in the program did not 
allow a meaningful test. 
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Analysis of the Association Betveen 
Program Exposure and College Fnrollncnt 
Institution G 



Months 


Dili 


in program 


Yes 


1 to 10 


30 


11 to 20 


12S 


Over :0 


174 


Total 


329 



Student enroll in college? 



No 

95 
121 

78 

294 



Total 

125 
246 

252 

623 



Significance of association: highly significant. 

Degrees of freedon: 2 
Chi-square value: 68.687 
Confidence level: 0.99* 



Analysis of the Association Between 
Program Exposure and Col lege Retention 
Institution C 

Is student still 
Months enrolled or graduated? 



in program Yes No Total 

1 to 10 14 16 30 

11 to 20 70 54 124 

Over 20 _96 _7_7 17_3 

Total 180 147 327 



Significance of association: insignificant. 

Degrees of freedon: 2 
Chi-square value: 0.964098 
Confidence level: 0.30 to 0.50 
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Analysis of the Association Between 
Program Exposure and College Enrol Inent 
Institution ]\ 



yio n t ns 


1)1 u SLUucnt 


cnro 1 1 


in c 0 1 lege . 


in program 


Yes 


No 


total 


1 to 10 


5 


42 


47 


11 to 20 


31 


59 


90 


over 20 


103 


63 


166 


Total 


139 


164 


30^ 



Significance of association: highly significant. 



Degrees of freedom: 2 
Chi-square value: 45.72S9 
Confidence level: 0.99* 



Analy>is of the Association Between 
Progran Exposure and College Retention 
Institution H 

Is student still 
Mo n t h s enrolled or graduated? 



in program Yes No Total 

1 to 20 9 27 36 

Over 20 ^ ^ 121 

Total 73 63 136 



Significance of association: highly significant. 

Degree of freedom: 1 
Chi-square value: It. 6618 
Confidence level: 
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Analysis of the Association Between 
rrogran Exposure and College Enrollment 
institution I 



Months 
in program 

1 to 10 

n to 20 

Over 20 



Did student enroll in college? 
Yes No Total 



15 

66 
153 



68 
83 
53 



81 

149 

206 



Total 



232 



204 



436 



Significance of association: highly significant, 

Degrees of freedon: 2 
Chi-square value: 86.3871 
Confidence level: 0.99* 



Analysis of the Associatioli Between 
Pro£ran Exposure and College Retention 
Institution I 



Months 
in program 

1 to 10 
11 tc 20 

Over 2 0 



Is student still 
enrolled or graduated? 



7 

23 
54 



No 

6 

42 

^8 



Total 

13 
65 

152 



Total 



80 



150 



230 



Significance of association: insignificant, 



Degrees of freedom: 
Chi-square value: 
Confidence level: 



1 .78422 

0.50 to 0.7O 
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Analy 


sis of the Association 


Between 


* lO g 1 din 


Exposure and College Enrollnent 




Institution J 






Did student enroll in college? 


Xii pi Id 111 


Yes No 


Total 


1 to 10 


3 19 


22 


11 to 20 


7 9 


16 


VJ V C I ^ \J 


1_6 16 


32 


Tot al 


26 44 


70 


Significance 


of association: highly 


significant-. 



Degrees of freedom: 2 
Clii-square value: 7.77168 
Confidence level: 0.95 to 0.98 



Analysis of the Association Between 
Progran Exposure and C ollege Retention 
Institution J 

Is student still 

Months enrolled or graduated? 

in program Y es No Total 

1 to 10 
11 to 20 
over 20 

Total 

Note: No analysis was performed because the distri- 
bution of months in the program did not al- 
low a meaningful test. 
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Analysis of the Association Between 
Program Exposure and College Enrollment 
Institution K 



Months 
in program 




Did student enroll in college? 


Yes / 


No 


Total 


1 to 10 




10 


35 


45 


11 to 20 




44 


44 


88 


Over 20 




34 


14 


48 


Total 




M 


93 


181 


Significance of association: 


highly 


significant. 


Degrees of 


freedom: 


2 






Chi- square 


value : 


22.101 







Confidence level: 



0.99+ 



Analysis of the Association Between 
Program Exposure and College Retention 
Institution K 



Months 
in program 



Is student still 
enrolled or graduated? 



Yes 



No 



Total 



1 to 20 
Over 20 



17 
13 



28 
IS 



45 
28 



Total 



30 



43 



73 



Significance of association: insignificant. 



Degrees of freedom: 
Chi-square value: 
Confidence level: 



0.236069 
0.30 to 0.5 0 
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Analysis of the Association Between 
Program Exposure and College Enrollment 
Institution L 



Months 
in program 


Did 


student enroll 


in college? 


Yes 


No 


Total 


1 to 10 


14 


45 


59 


11 to 20 


44 


55 


99 


Over 20 


55 


56 


91 


Total 


113 


136 


249 



Significance of association: highly significant. 

Degrees of freedom: 2 
Chi-square value: 19,5194 
Confidence level: 0.99+ 



Analysis of the Association Between 
Program Exposure and College Retention 
Institution L 

Is student still 
Months enrolled or graduated? 



in progra.n Yes No Total 

1 to 20 18 32 50 

Over 20 11 IZ 1^ 

Total 37. 59 96 



Significance of association: insignificant. 

Degrees of freedom: 1 
Chi-square value: 0.104702 
Confidence level : 0. 50 to 0.7 0 
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Analysis of the Association Between 
Program Exposure and College Enrollment 
Institution M 



Months 




Did student enroll 


in college? 


in prograin 




Yes 


No 


Total 


1 to 10 




24 


51 


75 


11 to 20 




30 


21 


51 


Over 20 




14 


_6 


20 


Total 




68 


78 


146 


Significance of association: 


highly significant. 


Degrees of 


freedom : 


2 






Chi-square 


value : 


13.8885 






Confidence 


level : 


0.99 + 






Analysis of 


the Association Between 


Program Exposure and College Rentention 






Institution H 








Is 


s tudent 


still 


Months 




enrolled or graduated? 


in prograin 




Yes 


No 


Total 


1 to 10 




13 


10 


23 


11 to 20 




15 


14 


29 


Over 20 




_6 


8 


11 


Total 




34 


52 


66 



Significance of association: insignificant . 

Degrees o£ freedom: 2 
Chi-square value: 0.651494 
Confidence level: 0,20 to 0.30 
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Analysis of the Association Between 
Program Exposure and College Enrollment 
Institution N 



Months 


Ulci stuaent 


enroll 


in college? 


in program 


Yes 


No 


Total 


1 to 10 


6 


23 


29 


11 to 20 


150 


71 


221 


Over 20 


15 


_4 


19 


Total " 


171 


98 


269 



Significance of association: highly significant. 

Degrees of freedom; 2 
Chi-square value: 26.732 
Confidence level: 0.99+ 



Analysis of the Association Between 
Program Exposure and College Retention 
Institution N 



Months 
in program 



Yes 



Is student still 
enrolled or graduated? 



No 



Total 



1 to 20 
Over 20 



49 
6 



77 
6 



126 
12 



Total 



55 



83 



138 



Significance of association: insignificant. 



Degrees of freedom; 
Chi-square value: 
Confidence level: 



0. 195955 

0. 30 to 0.50 
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DEPARTMENT OF HEALTH. EDUCATION, AND WELFARE 

WASHINGTON. DX. 20201 



OFFICE OF THE SECRETARY 

NOV 2 8 1973 



Mr. Morton E. Henig 
Associate Director 
Manpower and Welfare Division 
General Accounting Office 
Washington y D.C. 

Dear Mr. Henig: 

Enclosed is the Department's response to the Ceneral Accounting 
Office report on the effectiveness of the Upward Bound Program 
in preparing disadvantaged students for postsecondary education. 
If you should need further information relative to the contents 
of the response, please do not hesitate to let me know. 

Sincerely yours, 

Jo^iriD. Yoiitg I 

ilftant «lcretary. Comptroller 

Enclosure 
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EFFECTIVENESS QF THE UPVARD BOUXD PROGRAM 
IN PREPARING DISADVANTAGED STUDENTS 
FOR POSTSECONDARY EDUCATION 



As indicated by our comments to GAO*s recoinnendations , following^ the 
Department concurs that a need exists to strengthen many aspects of the 
administration of the Upward Bound program. We believe that the report 
fairly discusses many but not all of tV^e probleTns faced in serviag low- 
Income youths who have the potential for success in postsecondary educa- 
tion. 

Recommendation //I 
GAG Recommends: 

Establish clear, measurable objectives for the Upward Bound pro-rata 
and periodic milestones to measure the effectiveness of the progratp 
in accomplishing the objectives as required by HEW*s Operational 
Planning System. Also, develop guidelines requiring that the proj- 
ects establish similar objectives . 

Department Comments: 

The Office of Education will prepare a policy statement designed to 
clarify the several purposes and objectives of the Upward Bound pro-- 
gram. To the extent that these objectives can serve as measurable 
criteria of program effectiveness, the Office of Education will also 
develop a long range evaluation plan for assessing the program *s 
effectiveness in meeting the clarified objectives. Once these steps 
have been ttaken, we will develop the recommended guideliies for 
projects . 
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Reconr.€ndat ion P2 
r^AO RecoCTnends: 

D evelop guidelines requiring projects to (I) perform and docu Tn eigt com* 
prehensive need assessTnent on all students^ including their Tnotivation 
levels, (2) design a currlculuni to meet the needs Identified^ and 
(3) periodically measure the progress made in ineetin^ these needs* 
The guidelines should also in c lude additional guidance to assist the 
projects in accomplishing these three requireipents ^ 

I>epartnent Cotmiients: 

A« discussed with CAO representatives, the Department concurs with this 
recoinn^endat ion with two qualifications: 

1. There are many ways in which student motivation can be 
ascertained, including the development of psychological 
profiles on students* The Department does not believe 
that the development of such profiles is an activity in 
which it or the Upward Bound projects should be Involved, 

2. Comprehensive assessment of students* needs and the measure- 
ment of those needs can be performed with a variety of 
instruments and techniques, including standardized tests. 
The Department does not support the policy of basing assess- 
ment and measurement solely on standardized tests. It also 
does not believe that every project should be required to 
use Identical assessment and measurement techniques* Most 
especially, it would not require every project to administer 
the same single or battery tests to accomplish this 

ob ject i ve . 

The impl^^'^entat icr. of ^^his rcccnmendat Ion involves problems of timing* 
Application forms and program manuals have been mailed to proposers 
for FY 7^ funding. Little can be done to change requirements for the 
current grant cycle. However, the Office of Education will negotiate 
with prospective grantees to implement needs analysis and progress 
neasurement and, to the extent possible, pre- artd post-testing within 
projects will be encouraged. For the FY 75 funding cycle, the Office 
of Education will review Upward Bound regulations to determine the 
feasibility of requiring such measures as a part of future program 
requi remt »^ts B under the current statue. 
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Recotap<^ndation #3 
GAO Recommends: 

Improve the Upward Bound management information system so proRram 
m anagers are provided with the data needed in developinR. planning 
and evaluating the Upvard Bound program > The system should provide 
program managers the data needed to (I) assess the specific educa- 
tional needs of students, (2) Identify the major problems that must 
be dealt with, (3) devj^ge specific strategy for overcoming these 
problems, (^) igplesienlt an education program responsive to student's 
needs, (5) measure progyxess made toward meeting stated goals, and 
(6) assess the effectiveness of the progiraa and each project . 

Department Comments: 

The Department agrees that the Upward Bound management information 
system needs improvement. In fact, preliminary steps have already 
been taken toward this goal, and toward iiaproving the management 
information system of the other Trio programs [Talent Search and 
Special Services for Disadvantaged Students]. A contract has been 
let to determine the essential information needs for effective 
management of the three programs at all levels - project, regional 
and national. Once adequate data has been developed, the Office of 
Education will develop an Objective and Operating Plan for implemen- 
ting (the intent of) this recomnendation. 
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Rccoamgndatlon #4 
GAO Recomends: 

StretiRthen the monitoring proRran to ensure that all prolects operate 
in accordance with national Intent and that the stated oblectlves of 
the projects are really|tic and are being accomplished vlthln the 
expected time frame * 

Department Comments: 

Efforts have already beer taken to strengthen the monitoring program 
in that the regions are beginning to implement a management by 
objective system for all Upward Bound, Talent Search and Special 
Services programs. This will Include (1) analysis of the target 
population, (2) clearly stated project objectives, (3) comprehensive 
student needs assessment, (4) development of project work programs 
based upon individual student needs, (5) implementation plan for 
each objective, (6) self -evaluation of vork programs, (7) periodic 
review of progress and fiscal reports. 

The steps outlined above with the required documentation of etudent 
eligibility and need will be the foundation of more effective moni*- 
toring of the Upward Bound projects. ^ Equally impor ant are the ''site 
visits,*' which are more than an inspection visit. OE program staff 
and field readers will be utilized to th^ greatest extent possible to 
Insure that projects are actually fulfilling the program requirements, 
assist the projects in correcting deficiencies and providing advice 
and other forms of expertise toward improvement of program. Training 
programs will be conducted to improve the effectiveness of site visits. 
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Recongnendatlon #5 
GAO Reconshends: 

Develop guidelines requiring regional offices to take steps to ensure 
that projects select students in accordance with the selection guide- 
lines and document the basis used . 

Depat ttuent Cotonents : 

We concur that such guidelines are needed and intend to start gather-- 
ing the data necessary for their development within a short time. 

GAO Recommends: 

Provide projects with guidelines defining an academic risk student in 
terms of achievement measures such as standardized achievement tests 
and grade point average s* 

Department Comments: 

While ve agree vltti the need for a more precise definition of the term 
**academic risk/' ve would hesitate to limit its definition to terms 
of achievement measures such as standardized achievement tests and grade 
point averages.** We feel these Kinds of criteria wouldn't identify 
adequately the type of student that Upward Bound is intended to help. 
For some time, the Office of Education has beea considering how to best 
define an academic risk student for the purposes of deciding who would 
benefit more from participation in the Upward Bound programs, with the 
preciseness needed for unfirom application nationwide. This matter will 
continue to receive much attention, particularly in discussions with 
experts in compensatory education until it is resolved. 

GAO Recommends: 

Include an editing process in its computer program which would auto- 
matically identify students who do not meet academic risk and inco me 
criteria, so regional officials can take more timely correctiv e action . 

Department CoimBents: 

We concur. With respect to academic risks, we will include appropriate 
checks when the criteria mentioned above has been developed and can be 
used as the basis for their development. With respect to income 
criteria, such steps have already been taken. In June 1972, the Upward 
Bound information syst^ identified the problem of students not meeting 
income guidelines and the regional directors of higher education were 
directed to take corrective action. Additionally, in April 1973, the 
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Upward Bound inforraation systen implemented a procedure to Identify 
individuals reported over income guidelines. As a result of these 
efforts, the number of students over poverty guidelines has decreased 
from 14S as reported in 1972 to where presently only 6% of cu/rent 
regular Upward Bound students exceed income eligibility criteria. 



APPENDIX III 



PRINCIPAL OFFICIALS OF THE 
DEPARTMENT OF HEALTH, EDUCATION, AND WELFARE 
RESPONSIBLE FOR ACTIVITIES DISCUSSED IN THIS REPORT 



Tenure of office 
Fron To 

SECRETARY OF HEALTH, EDUCATION, 
AND WELFARE: 

Caspar V.'. V.'einberger 
Frank C. Carlucci (acting) 
Elliot L. Richardson 
Robert li. Finch 



Feb. 1973 

Jan. 1973 

June 1970 

Jan. 1969 



Present 
Feb. 1973 
Jan. 1973 
June 1970 



ASSlbTANT SECRETARY FOR EDUCATION: 
Cliarles B. Saunders, Jr. 

(acting) Nov. 1973 Present 

Sidney P. Marland, Jr. Nov. 1972 Oct. 1973 



COMMISSIONER OF EDUCATION: 
John R. Ottina 
John R. Ottina (acting) 
Sidney P. Marland, Jr. 
Tprrel H. Bell (acting) 
James E. Allen, Jr. 



Aug. 


1973 


Present 


Nov. 


1972 


Aug. 


1973 


Dec. 


1970 


Oct. 


1972 


June 


1970 


Dec. 


1970 


May 


1969 


June 


1970 
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Copies of this report are available at o cost of $T 
from the U.S. General Accounting Office, Roofn 6417« 
441 G Street, N.W., Washington, D.C. 20548. Orders 
should be arcomponied by o check or money order. 
Please do n vt send cash. 

When ordering a GAO report please use the B-Number, 
Date and Title, if available, to expedite filling your 
order. 

Copies of GAO reports are provided without charge to 
Members of Congress* congressional committee staff 
members, Government officials, news media, college 
libraries, faculty members and students. 



